This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents mil not correct images, 
please do not report the images to the 
Image Problem Mailbox. 




A METHOD FOR DYNAMICALLY ASSIGNING AND DISPLAYING CHARACTER ShoRTCUTS ON A COMPUTING 
DEVICE DISPLAY Page 1 of 1 2 

-134541 

locket No. 109927-134541 



A METHOD FOR DYNAMICALLY ASSIGNING AND DISPLAYING 
CHARACTER SHORTCUTS ON A COMPUTING DEVICE DISPLAY 



Inventor 

Kevin Allan 



Action Engine Corporation 



Attorney Docket Number 

109927-134541 
10 IPG No. AE-P021 



Adam L.K. Philipp, Patent Attorney, Reg. No. 42,071 

Schwabe, Williamson & Wyatt 
1211 SW Fifth Avenue, Suites 1600-1900 
1 5 Portland, OR 97204-3795 

(503) 222-9981 
fax (503) 796-2900 
aphilipp@schwabe.com 



Filing Date: October 10, 2003 

SEA/1 09927/1 34541/akp/3 1 5701 . 1 



Express Mail Label No. EU492036089US 



A METHOD FOR DYNAMICALLY ASSIGNING AND DISPLAYING CHARACTER ShwATCUTS ON A COMPUTING 
DEVICE DISPLAY Page 1 of 1 2 

IPG No. AE-P021 
Atty. Docket No. 109927-1 34541 



CROSS-REFERENCE TO A RELATED APPLICATION 

This application claims the benefit of U.S. Provisional Application No. 
60/417,814,.filed on October 10, 2002, and entitled METHOD FOR 
DYNAMICALLY ASSIGNING AND DISPLAYING NUMERIC SHORTCUTS 
5 ON A WIRELESS MOBILE DEVICE DISPLAY, the subject matter of which is 
incorporated herein by reference. 

FIELD OF THE INVENTION 

The present invention relates to the field of computer communications. 
More specifically, the present invention relates the provision of a user interface 
10 accessing hypertext links using a computing device. 

BACKGROUND OF THE INVENTION 

Most software applications on computing devices are controlled via a 
graphical user interface ("GUI"). The GUI displays selectable elements, such as 
hypertext links and the like, on a display device for a user to view and select. 

15 Typically, a user uses a pointing device, such as a mouse, stylus or track ball, to 

select the selectable elements within the GUI. However, not all users are able to use 
pointing devices, and not all computing devices provide such pointing devices. In 
particular, on many compact devices such as personal data assistants ("PDA") and 
cellular telephones, such pointing devices are unavailable, or inconvenient. For 

20 these reasons there is a need to access selectable elements in a GUI without a 
pointing device. Numerous conventional methods developed for selecting 
selectable elements in a GUI without a pointing device have been developed. 

One early software application for browsing hypertext documents (with 
selectable elements, i.e., links) is the LYNX program. LYNX used two methods for 

25 accessing links without a pointing device. The first LYNX method had a user move 
sequentially through each link using a cursor key. Users would then actuate the 
"enter" key to select a link that was highlighted. However, this first method remains 
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undesirable as it requires multiple key strokes to activate a specific link, and still 
further requires a user to constantly view the GUI while locating a specific link. In 
a GUI with a large number of selectable elements, such a method may deter a user 
from using the system. 
5 Another method of accessing links within the LYNX software is by turning 

on a numbering system such that each link in the document is statically paired with 
a number within the body of the document. However, the static numbering method 
of accessing hypertext links is both aesthetically unappealing and disturbs the layout 
and appearance of the contents of the hypertext document. The numbers tend to 

10 clutter the GUI with unnecessary information and thus reduce the overall ease of use 
for the consumer. Furthermore, in small displays, such as those on portable 
computing devices, the numbers use up valuable display space that could be used to . . 
store and display meaningful content. 

Thus, a great need exists for a method of selecting selectable elements in a 

15 GUI without a pointing device. There is a further need for such a method to be both 
efficient and user friendly under the context of a limited number of input keys. 

BRIEF DESCRIPTION OF DRAWINGS 

The present invention will be described by way of exemplary embodiments, 
but not limitations, illustrated in the accompanying drawings in which like 
20 references denotes similar elements, and in which: 

FIGURE 1 is a block diagram of a computing device that provides an 
exemplary operating environment for an embodiment of the present invention. 

FIGURE 2 is a representation of an exemplary phone computing device 
interface as used in one embodiment of the present invention. 
25 FIGURE 3 is a flow diagram illustrating a routine for link numbering in 

accordance with the present invention. 

FIGURE 4 is a flow diagram illustrating a hypertext display subroutine 
suitable for use in the routing illustrated in FIGURE 3. 
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FIGURES 5a-5d are exemplary screen shots of a browser display having 
numbered links formed in accordance with the present invention. 

FIGURE 6 is an exemplary screen shot of a browser display having 
numbered links on an image map formed in accordance with the present invention. 

5 DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

The detail description which follows is represented largely in terms of 
processes and symbolic representations of operations by conventional computing 
components including processors, memory storage devices for the processors, 
connected display devices, and input devices, all of which are well known in the art. 

1 0 The processes and operations may utilize conventional computing components in 
the heterogeneous distributed computing environment, including remote storage 
servers, network servers and memory storage devices; such processes, devices and 
operations also being known to those skilled in the art and others. 

Bubble links allow users to select selectable elements in a GUI by pressing 

1 5 the corresponding character of a computing device's keyboard. In one exemplary 
embodiment of the present invention, the computing device is a cellular telephone 
200 with a display screen 210 and a numeric keypad 250. The bubble links on such 
an embodiment of the present invention may include bubble links with the numeric 
characters "1-9" displayed next to up to nine selectable elements displayed on the 

20 cellular telephone's display. Accordingly, the selectable elements on the cellular 
phone's display 210 would be selected once the numeric character corresponding to 
the bubble link in the cellular telephone's display is selected from the numeric 
keypad 250. 

FIGURE 1 illustrates an exemplary computing device suitable for use in the 
25 present invention. Those of ordinary skill in the art and others will appreciate that 
the computing device 100 may include many more components than those shown in 
FIGURE 1 . However, it is not necessary that all of these generally conventional 
components be shown in order to disclose an enabling embodiment for practicing 
the present invention. As shown in FIGURE 1, the computing device 100 includes a 
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network interface 130 for connecting to remote devices. Those of ordinary skill in 
the art will appreciate that the network interface 130 includes the necessary circuitry 
for such a connection, and is also constructed for use with appropriate protocols for 
such a connection. 

5 The computing device 100 also includes a processing unit 1 10, a display 140 

and a memory 150 all interconnected along with the network interface 130 via a bus 
120. The memory 150 generally comprises a random access memory ("RAM"), a 
read-only memory ("ROM") and a permanent mass storage device, such as a disk 
drive. The memory 150 stores an operating system 155 and a web browser 160. It 

10 will be appreciated that these software components may be loaded from a computer 
readable medium into memory 150 of the client device 100 using a drive 
mechanism (not shown) associated with the computer readable medium, such as a 
floppy, tape or DVD/CD-rom drive or the network interface 130. 

Although an exemplary computing device 100 has been described that 

15 generally conforms to a conventional computing device, those of ordinary skill in 
the art will appreciate that a computing device 100 may be any of a great number of 
computing devices capable of communicating with remote devices. In various 
embodiments of the present invention, the computing device 100 may be a cellular 
phone, PDA, general purpose computing device and the like. .. 

20 FIGURE 2 depicts one exemplary computing device 100 for use in the 

present invention in the form of a cellular telephone 200. The cellular telephone 
200 includes a phone display 210 and a keypad 250. The keypad includes numeric 
keys 225, as well as two special keys. The first special key is a scroll key 215 for 
traversing data displayed in the phone display 210. The second special key is a 

25 dynamic link key 220, which in FIGURE 2 is shown as the "0" key 220 in the 

keypad 250. Also shown in FIGURE 2 are character keys 225 (i.e., number keys 1- 
9) which correspond to characters that are dynamically associated with selectable 
elements (e.g., icons, file names, program names, links to files, form fields, etc.) or 
links (e.g., text links, image links, hidden links, image map links, etc.) displayed 
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in the phone display 210. The dynamic association and rendering of links with 
associated characters is further described below with regard to FIGURES 3 and 4. 

FIGURE 3 is a flow chart illustrating actions of one exemplary embodiment 
of the present invention where links within a hypertext document are dynamically 
5 associated with selectable characters, and wherein the character association is 

displayed with the links. The link handling routine 300 shown in FIGURE 3 begins 
at the decision block 305 where determination is made whether character links are 
turned on (e.g., are to be displayed) in the current GUI. If so, then processing 
continues to decision block 310 where a further determination is made whether the 

10 current "focus" (e.g., placement of the current cursor or GUI selected element) is in 
a text field. If so, then processing continues to block 315. Similarly, if in decision 
block 305 it was determined that character links were not turned on in the current 
GUI, then processing would also continue to block 315 where a hypertext document 
is displayed with no character links. 

1 5 If, however, in decision block 3 1 0 it was determined that the focus of the 

current GUI is not in a text field, then processing continues to subroutine block 400 
where the hypertext document is displayed with character links. Subroutine 400 is 
illustrated in FIGURE 4 and described in greater detail below. Processing then 
continues to decision block 320 which waits until an input is received. 

20 Once an input has been determined to have been received in decision block 

320, then processing continues to decision block 325 where a determination is made 
as to the type of input received. If a scroll key 215 was pressed, then processing 
continues to block 335 where the hypertext document is scrolled. Next, processing 
continues back to decision block 305. 

25 If, however, in decision block 325 is was determined that the key pressed 

was the dynamic link key 220, then processing continues to decision block 340. In 
decision block 340, a determination is made whether all links in the display (e.g., 
phone display 210 or computing device display 140) have been displayed and that 
character links were turned on then in block 345 the display of character links is 

30 turned off and processing proceeds back to decision block 305, 
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If, however, in decision block 340 it was determined that all links have not 
been displayed or that the character links are not turned on, then processing 
continues back to subroutine block 400. 

Returning to decision block 325, if some other key has been pressed, then 

5 processing continues to decision block 355 where a determination is made whether a 
character key associated with a link was pressed; in which case processing continues 
to block 360 where the associated link is automatically activated. If, however, on 
decision block 355 it was determined that some other key other than a character key 
was pressed as input, then processing continues to block 365 where the input is 

10 processed as appropriate. After processing continues to either block 360 or 365, 
then routine 300 proceeds back to decision block 305. 

FIGURE 4 illustrates an exemplary hypertext document display subroutine 
400 having character links. The hypertext document display subroutine 400 begins 
at decision block 405 where a determination is made whether any XML display 

1 5 codes are included in the hypertext document that affect the display of character 
indicators for the character links. If so, then processing continues to block 410 
where the XML display codes (or other conventional embedded codes within a GUI 
display description) are interpreted. Processing then continues to decision block 
415. Similarly, if no XML display codes are found in decision block 405, then 

20 processing also continues to decision block 415. 

In decision block 41 5, a determination is made whether : there are any links in 
the hypertext document that are already associated with characters. If so, then 
processing continues to block 430 where the links are dynamically re-associated 
with up to a predetermined number (e.g., nine characters if numeric characters "1-9" 

25 are used) of characters. Those of ordinary skill in the art and others will appreciate 
that the number of links to associate with characters will often correspond generally 
to the number of characters available to a user when operating some form of input 
device (e.g., keyboard, touch pad, touch screen, etc.). Processing then continues to 
block 425. If in decision block 415 it was determined that no links are associated 

30 with characters, then in block 420 any links in the current display are dynamically 
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associated (e.g., as the display is updated on the device) with up to the 
predetermined number of characters. Processing then continues to block 425. 

In block 425, the hypertext document (or other GUI with selectable 
elements) is rendered with character links. The character links are rendered 
5 according to default display characteristics or in the case where XML display codes 
were received and interpreted according to the XML display codes which may effect 
the size, font, color, transparency, position or other display characteristics of the 
characters that are approximate to the links in the hypertext document. In most 
cases the character links (bubble links) are displayed next to or at least proximate to 

10 their respective associated links (or selectable elements). Subroutine 400 then 
returns to its calling routine at block 499. 

FIGURES 5a-d and FIGURE 6 illustrate exemplary screen shots of graphical 
user interfaces with characters associated with selectable elements. FIGURES 5a 
and 5b illustrate GUIs where a browser 500A-B includes a plurality of links with 

15 associated characters 505 A-B. In FIGURE 5a, the browser 500A includes links "A- 
I" that have associated numeric characters "1-9" displayed jointly as character links 
505 A. As noted earlier with regard to the processes illustrated in routine 300 and 
subroutine 400 above, a user may designate a new set of links to associate with 
characters. Accordingly, in FIGURE 5b links "J-P" are associated with numeric 

20 characters "1-7" to form character links 505B which would result from a user 

toggling the next set of links to be re-associated with characters; e.g., by selecting 
the dynamic link key 220 on an exemplary cellular phone device 200 illustrated in 
FIGURE 2. 

FIGURES 5c and 5d illustrate similar re-association generated by a user 
25 scrolling through a display of links in a browser. FIGURE 5c illustrates links "A-I" 
associated with numeric characters "1-9" to form character links 505C. FIGURE 5d 
illustrates the browser 500D after the user has selected a scroll button (e.g., scroll 
button 215) and has scrolled the browser 500D down to display links "F-N". 
Accordingly, the links were dynamically re-associated such that only the visible 
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links are associated with characters. Therefore, links "F-N" are associated with 
numeric characters "1-9" to have character links 505D. 

FIGURE 6 illustrates a further embodiment of the present invention with 
non-textual links associated with characters. Accordingly, in the browser 600 
5 shown in FIGURE 6, there is an "image map" displayed with four regions 610, 615, 
620 and 625 that each have a numeric character "1-4" associated with the selectable 
link region. Actuating a numeric key from "1-4" would have the same effect as a 
pointing device activating one of the link regions region 610, 615, 620 or 625 in the 
browser 600, 

10 While the presently preferred embodiment of the invention has been 

illustrated and described, it will be appreciated that various changes can be made 
therein without departing from the spirit and scope of the invention as defined by 
the appended claims. In particular, while the exemplary embodiments of the present 
invention have been described with regard to hypertext documents within a browser, 

1 5 those of ordinary skill in the art will appreciate that many other GUIs having 
displayed selectable elements are suitable for use with the present invention. 
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